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1 Introduction. 



It is commonly acknowledged that explicit expressions for the transient behaviour of func- 
tionals of stochastic models can be found only in a few special cases. In view of this, efforts 
of generations of probabilists have been focused on the study of the rate of convergence, as 
time t — s> oo, to the steady state of a process. During the last two decades a remarkable 
progress was made in this field, regarding time- homogeneous Markov chains, as a result of 
implementation and development of sophisticated techniques: coupling, logarithmic Sobolev 
inequalities, the Poincare inequality and its versions arising from the variational interpretation 
of eigenvalues, and duality. For reference, we recommend recent review and research papers 
|n|, ^Hl, ^2j, |H], ^I]- The new stream of nowadays research was motivated by new 
fields of applications, s.t. algorithms of Monte Carlo for simulation of Markov chains and 
enumeration algorithms in computer science and group theory. 

A variety of problems for queueing models, among them stability, were investigated by V. 
Kalashnikov |22j . 

There is also a growing interest in time-nonhomogeneous Markov chains (see ^3], [21], [2S1) 
that model a large number of real queuing systems. Most of research on nonhomogeneous 
queues is devoted to various methods of approximation of their transient behaviour (see [7j, 
[77] . [2H] and references therein.) A quite different approach is used in the study of annealing 
processes (for references see 0). Here Markov chains considered have exponentially vanishing 
intensities, as t oo. The research in this field is aimed to estimate the rate of convergence 
of the process to the invariant distribution. 

Our paper is devoted to the estimation of the rate of of exponential convergence of nonhomoge- 
neous queues exhibiting different types of ergodicity. The main tool of our study is the method, 
which was proposed by the second author in the late 1980s (see jHZ|) and was subsequently 
extended and developed in different directions in a series of joint papers by the authors of the 
present paper. The method originated from the idea of Gnedenko and Makarov(|15j) to em- 
ploy the logarithmic norm of a matrix to the study of the problem of stability of Kolmogorov 
system of differential equations associated with nonhomogeneous Markov chains. The method 
is based on the following two ingredients: the logarithmic norm of a linear operator and a 
special similarity transformation of the matrix of intensities of the Markov chain considered. 
In the paper we apply the method to a new general class of Markov queues with a special 
form of nonhomogenuity that is common in applications. Namely, we consider the case of 
asymptotically periodic arrival and service rates. 

The present paper is a substantially modified and extended version of our preliminary report 
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2 Preliminaries. 

We consider a contionuous time nonhomogeneous birth and death process (BDP) 

^ (t) J t > on the state space E = {0, 1, ... , A^} , < oo, with time dependent intensities 

of birth A„ (t) , t > 0, and death finit) , t > 0, n G E. Namely, 



P{X{t + h) = j\X{t) =i) = < 



Xi {t)h + o{h), if j = i + l 

fii (t) h + o{h) , if j = z — 1 

l-{Xi{t)+i2,{t))h + o{h), if j=i 

o{h), if \i-i\>l, 



(2.1) 



where /i > and, for the sake of brevity, o{h) = Oi{t,h), i & E denotes different quantities 
s.t. for all t > 0, 



hm ^l^P^M^ = 0. 

h-*0 h 



Denote 



p,,{s,t) = Pr{X{t)=j\X{s)=i),i,jeE, 0<s<t (2.2) 

and Pi (t) = Pi {X (t) = i) , i & E , t > the transition and the state probabilities respec- 
tively. 

Let p = pit) = (poit), . . . ,piy(t))'^, t > be a column vector of probabilities of states and let 
^{t), t > be the intensity matrix induced by ()2.1|) . 

Then the evolution of the process X{t) is described by the forward Kolmogorov system 

^ = A(t)p, p = p(t), t>0. (2.3) 

The Cauchy operator U {t,s) , < s < t of ()2.3|) is given by the matrix f/^ (t, s) = P [s, t) : = 
(pij (s, t))f^-^Q . We denote throughout the paper by || • || the li— norm, i. e. ||x|| = J2i£E 



1 1 1 



for X = (xo, . . . , xn)^ and ||5|| = sup , ioi B = {hij)^.^ . 

i&E 

Let Vt be the set of vectors Vt= {x = (xq, . . . , xjv)"^ : x > 0, ||x|| = 1}. Assuming that 
p(t) G r2, t > is a solution of (j2.3p . we consider the following types of ergodicity of continuous 
time Markov chains. 

Definition 1 . A Markov chain X{t), t > on E is called 
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ergodic, if there exists a probability measure tt = (7r(0), . . . , tt{N))'^ on E, 
such that lim ||p (t) — vr|| = 0, for all p G fi; 

weakly ergodic, if lim llp*^^) (t) — p^^^ {t)\\ = 0, for all p^'^ G fi, i = 1,2; 
null-ergodic , if Pn{t) ^0, n E E, as t oo, for all p E and 
quasi-ergodic, if there exists a probability measure vf on E, such that 



lim 

t— >oo 



1 /■* 

- / T) (t) dr — TT 



0, 



for all p E Q. 



Remark 1 . BDP can be both weakly ergodic and null-ergodic, see Example 1 in liyf - Hov- 
ewer, quasi- ergodic BDP can not be null-ergodic. 

We deal with the class of nonhomogeneous BDP given by 

A„ (t) = A„a (t) , /i„ (t) = /i„6 (t) , t>0 neE. (2.4) 

We assume throught the paper that the basic functions a {t) > 0, b{t) > 0, t > are locally 
integrable on [0, oo) and asymptotically periodic with periods Ti,T2 correspondingly. The 
latter means that 



a{t) = ai(t) + a2(t), b{t) = bi{t) + 62^, t> 0, 



where 



ai(t + Ti) = ai(t), 6i(t + T2) = 6i(t),t > 0, lim f|a2(t)| + |62(t)| 
Regarding the rates Xn, fJ^n, we assume that 

A„ > 0, n = 0, . . . , iV - 1, /i„ > 0, n = 1, . . . , iV, /xo = 0. 
We also assume that in the case N = 00 there exist the limits 

lim An = A > 0, lim fin = fJ' > 0, 



(2.5) 



(2.6) 



(2.7) 



(2i 



while in the case N < 00, 



Aat = 0, A := Aat-i, /i := /iAT. (2.9) 

Some particular cases of the above setting were studied in [T7j, j2Sl, [IE]- In the aforementioned 
papers only ergodic BDP's were treated. In the present paper we shall investigate the rate of 
convergence in other cases given by Definition 2. 
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For reader's convenience, we recall the method of bounding of the the rate of convergence of 
BDP's that was introduced in 

First, we recall the definition of the logarithmic norm that was proposed for finite-dimensional 
spaces by Lozinskij [22] and generalized to Banach spaces by Daleckij and Krein 

Definition 2 Let B (t) , t > be a one-parameter family of bounded linear operators on a 
Banach space B and let I denote the identity operator. 
For a given t > 0, the number 



7 {B t = hm ^ 2.10 

is called the logarithmic norm of the operator B (t) . 

If ;B is a (A^ + 1)— dimensional vector space with li- norm, so that the operator B{t) is given 

by the matrix B{t) = (bij(t))fj^Q , t > 0, then the logarithmic norm of B(t) can be found 
exphcitly: 

j{B{t)) = snplbj,{t)+Y,\Kit)\], ^>0. (2.11) 
^ \ i^j J 

Associate now the family of operators B(t), t >0 with the system of differential equations 

^ = B{t)^, t>0, (2.12) 

where the functions bij{t), < i, j < N are assumed to be locally integrable on [0, oo). Then 
the logarithmic norm of the operator B(t) is related to the Cauchy operator V{t, s), < s <t 
of the system (jTT^ : 

. . XX , \\V(t + h,t)\\ - 1 , , 

75t =lim^ , t>0. 2.13 

From the latter one can deduce the following bounds on the i3-norm of the Cauchy operator 
V{t,s), 0<s<t: 

t t 
e i < ||^(t,s)|| <e' , 0<s<t. (2.14) 

Moreover, for any solution x(t) E B, t > of (j2.12p we have 

t 

- f 7(-B(r)) dT 

>e ' ||x(s)||. (2.15) 
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We will also make use of the fact that if B = li and all non-diagonal elements of B 



hj it) > 0, z^j, t>o, 



(2.16) 



then, by (ITTT1) , 

7(5(t)) = sup5^6,,(t), t>0, 



(2.17) 



and, consequently, for any solution x (t) , t > of ()2.12|) , s.t. x (s) > 0, we have 



t 



x(t)|| > « 



/ inf J] feij(T) dr 



x(s)||, 0<S<t 



(2.18) 



We adopt further on the definition of the decay function /5(t) of a nonhomogeneous ergodic 
Markov chain, given by the authors in jl7j. (Note that in the case of a homogeneous Markov 
chain, p(t) = P, t > is the spectral gap.) 

As a result of the previous discussion, we derive the following two-side bounding of the decay 
function P(t), t > 0, provided that the matrix B(t), t > obeys the condition ()2.16|) : 



In the method considered, the inequalities ()2.14|) . ()2.15|) . ()2.19j) constitute the main tool for 
bounding the decay function, as well as the rates of convergence of other types of Markov 
chains in Definition 1. Finally, we observe that in the case c{t) = c{t), t > 0, the estimate 
is exact. 

A straightforward implementation of (|2.19|) to the operator A{t) is not effective, since, by the 
definition of the intensity matrix and ()2.1H) . we have 7 {A (t)) = 0, t > 0. 
For this reason, we rewrite ()2.3|) as a system of nonhomogeneous differential equations with a 
nonsingular matrix. Namely, substituting in ()2.3|l 



c(t) := inf bij (t) < -/3(t) < c{t) := sup ^ kj (t) , t> 0. 



(2.19) 





(2.20) 



we have 



dz 
'di 



B{t)z{t) + i{t), t>0, 



(2.21) 



where 



B{t) = {ai,{t)-aio{t), I, J = 1,...,N}, 
f{t) = {aio{t),...,am{t)f , t > 0. 



(2.22) 
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The solution of ()2.2H) is given by 



z{t) = V {t, s) z (s) + jv {t, r) f (r) dr, < s < t, 



where V (t, s) is the Cauchy operator of the system ()2.21|1 . 

The following simple relationship holds between pairs of solutions 



(2.23) 



zW(t), p» = p«(t), t>0, 1 = 1,2 



of (jTTT]) and (j2ini) respectively: 



|p(l)_p(2)| 



+ ||z«-z(2)| 
Consequently, 



I (1) (2)1 , I 



(1) ^ „(2) 



i>l 



i>l \ i>l / 



i>l 



+ ||z«-z(2)| 



t > 0. 



(1)_Z(2)|| < ||pa)-p(2)|| <2||z« 



t > 0, 



(2.24) 



which will be used in our subsequent study. 

At this point, we note that the matrix B(t), t > in ()2.22j) lacks the property ()2.16|) of 
the original intensity matrix A{t), t > in ()2.H|1 . This fact prevents the implementation of 
()2.19|1 . To overcome this obstacle, we employ a similarity transformation of B{t), t > 0, that 
restores the property ()2.16|) . In JHl it was proven the existence of such transformation for 
general finite homogeneous Markov chains. However, its explicit construction is known so far 
for homogeneous BDP's only. The required transformation which is in the core of the method 
considered, was suggested in [SH]-|in]- It is given by the upper triangular N x N matrix 



D 



( do do do 
di di 
rfa 

V 



(2.25) 
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where di > 0, 



0,l,...,iV- 1. We have 
d^^ 



D 



-1 







Applying this transformation to the matrix -B(t), t > in ()2.22|1 , leads to the matrix 
DB{t)D-\ t > with the desired property : 



/ _ 



DB{t)D 



-1 



(Ao(t)+/ii(t)) dod^'fi,{t) 

dido^Xiit) -(Ai(t) +/i2(t)) did^^fi2{t) 
d2d^^X2{t) 

; 



V 



(2.26) 



We set further on, do = 1, and = for < oo, and denote = di+i/di > 0, i 
0, . . . , N — 1. By (|2.1H) , the logarithmic norm of the above matrix equals to 



-f{DB{t)D-^) = -miak{t) , t>0, 

k 



(2.27) 



where 



ak (t) = \k (t) + fXk+i (t) - 4+iAfc+i (t) - 5^ Vfc W , ^ > 0, k = 0,...,N-l. (2.28) 
(Here and in what follows 6o = 0.) 

Next, the substitution z{t) = D^^y{t), t > 0, transforms (|2.2H) into the system with the 
matrix DB{t)D~^, t > 0. Following Ei, we denote 

||z||^^ = ||Dz|| , t>0, (2.29) 

and g = inffc>o dk, to obtain, by virtue of (j2.25|) , 

||z|liz5>f t>0. (2.30) 

Now we apply ()2.19|) to the matrix DB{t)D~^ , t > 0, to derive the following effective way of 
two-side bounding of the decay function f3{t), t > of non-homogeneous BDP's: 

a{t) < (3{t) < a{t), t > 0, (2.31) 
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where 

= inf afc(t), a (t) = sup a kit), t>0 (2.32) 
k k 

In this connection note that, by the definition in ^Tj, the decay function (3{t), t > should 
+00 

satisfy / [3 (t) dt = +00, (but is not required to be nonnegative for all t >0). 

Therefore, ()2.3ip make sense provided the weights 6k, k = 0, . . . , N — 1 in ()2.28p are s.t. 

+00 

/ a(t)dt = +00. The way of finding such weights is discussed further on in the present 


paper. 

Next, with the help of (EHH), and (jT^ we obtain for weakly ergodic BDP's : 



\\p^'Ht)-p('^{t)\l^<e i-" ||p«(s)-p(2)(.)||^^, 0<.<t. (2.33) 

and 



I /1\ /r>N II 4 ~ r Cl{u)dU II II 

pW (t) - p(2) (t) < -e ' z«(s)-z(2)(s)l , 0<s<t. (2.34) 
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Here, in accordance with our notation ()2.29|) 



||z« (.) - z(2) (.)||^^ <J2<1^ \P^^ (^) -Pf (^)| , ^ > 0, (2.35) 

i>l 

i-1 

where Qi = d^, i = 1,...,N. 

m=0 

Clearly, (fO^ . (fOK|l are valid also for ergodic BDP's, by taking p^^) (t) = tt, t > 0. 
The reasoning analogous to the preceding one enables also to derive a lower bound for 
IIp*^^) (t) — p*^^) (t)|| . For this purpose, for a sequence of positive weights 6 = {5i, . . . , 6n-i), 
define the quantities 



Ck{t) = Xk{t)+f^k+i{t)+Sk+iXk+i{t) + S-^fik{t), t>0, k = 0,...,N-l. (2.36) 
Denoting 

C(t) =supa(t), t>0. (2.37) 

k 

we then have, 'y{—DB(t)D^^) = — sup^ijCfc (t) , t > 0, f (j2.11|) . Consequently, with the help 
of TTI^i , we obtain 
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p 



(1) 



(t) -p(2) (t)|| > ||z« (t) -z(2) > 



iDir^ WD-T' e'^ ||z« (s) - z(2) MIL < s < t. 



(2.38) 



Now we are in a position to describe the organization of the paper and its main results. As we 
aheady mentioned, we focus our study on a class of nonhomogeneous BDP's with intensities 
( I2.4j) - (j2.6p . Our main effort is devoted to estimation of a{t), t > for these BDP's. This is 
done in Section 3 and 4, by analyzing the specific form of the expressions fj2.28p in the case 
considered. As a result, we derive estimates of the rate of exponential convergence in different 
types of ergodicity. As a by-product of this study, we obtain also estimates of important 
for applications characteristics of transient behaviour of the above processes. The rest four 
sections are devoted to four particular nonhomogeneous queues widely known in the literature. 
We achieve an improvement of known estimates of the rate of convergence. We also obtain 
estimates of the expected length of queues. In the conclusion note that the stability properties 
of BDP's were explored in jHH, gl], HH! and [44j. 

3 Quasi-ergodic BDP 

Denote 



h = ^ , * = 0,...,iV-l, 

(3.39) 

where A > is a given number, and A, are defined in ()2.8j) . ()2.9j) . 

We denote E = {0, 1, . . . , iV - 1} , if < oo and ^ = if = oo and set in 

t Ti t T2 

am '■= lini - / a{u)du = — ai{u) du; bm '■= lim - / b{u) du = — hi{u)du. (3.40) 

t^co t J Ti J t^oo t J T2 J 



Theorem 1 Let for some A > 1 the following conditions fulfilled: 

a) for any k \k-il^k+i - hl^k > 0; 

b) 

fibm - AXam > 0, (3.41) 
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c) 



inf h:=f> 0. 

k&E 



(3.42) 



Let c G (0; 1) be arbitrary number such that a) c < A; > and b) c < f . Then there 
exists a sequence S = {6k, k E E) > 0, such that liminf 6k > I, if N = oo and 

a{t)>l{t):=c{fib{t)-AXa{t)), t>0, (3.43) 
(a) BDP X{t), t > is weakly ergodic, so that 



p« (t)-p(2) {t)l^<e 



z 

'JKu)du 

\\P^'{s)-p 



(2) 



s)||,^, 0<s<t, 



(3.44) 



and 



ip'"w-p'='wii<v^"""'"5:,.|p.'"(,) 

^ i>l 



pf\s) 



< s < t, 



where g and qi are defined in <\2. , i \2.34\ , 
(Hi) BDP X(t), t>Q is quasi-ergodic. 



(3.45) 



Proof. The condition < c < f < fk implies the inequahty 



c^AA/i - c (AAyUfc+i - Afc_iyu) + Xkfik - Xk-ifJ'k+i < 0, k e E 
for all k. Therefore using the inequality c < we obtain 

/Wfc / + cAA ~ 
< ^ , k E E. 



Put now 



Then 



and, finally 



/ifc+l - C/i 



/ifc Afe-i + cAA 



/^fc+i — c/i Afc 



A; e 



4+iAfc+i - Afc < cAA, /ifc+i - Vfc > c/i, G -E, 



(3.46) 



(3.47) 



(3.48) 



(3.49) 



ttfc (t) > c(/i6(t) - AAa(t)) , A;G^, t > 0, 



(3.50) 
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because in the case considered 



ttfc (t) = b (t) [fik+i - Vfc) - « (t) {6k+iXk+i - Afe) , k e E, t>0. (3.51) 
Now, for the case = oo we get from ()3.48|1 as A; ^ oo 

fi 1 



hminf 5fc > — - — = > 1 

— Cfi 1 — c 



because c < 1. 



Corollary 1 . // under the assumptions of Theorem 1, the BDP t > considered 

has a stationary distribution vr on E, then the BDP is ergodic and 

t 

4 - f l(u)du 

||p(t) - 7r|| < -e - 2_^qi\pi{s) - TTi], 0<s<t. (3.52) 
^ i>i 



Corollary 2 . Under the assumptions of Theorem 1, the BDP X{t), t > considered is 
exponentially weakly ergodic and for any e > there exists a constant K such that 

exp ^- j I {u) du^ < Ke-^^~'^^'-'\ t > 0, (3.53) 
where I = c {fibm — AAa^) ■ 

Theorem 2 Under the assumptions of Theorem 1, for any e > there exists a constant K 
such that 

Pr (X (t) < J I ^ (0) = 0) > 1 - q-^,K\oa^ (l + J_,)t/_ i ) ■ (3-54) 



Proof. Put in (jZ^ y (t) = Dz (t), then we have 

^ = DB(t)D-^y + Df(t), t>0. (3.55) 
dt 

The matrix DB (t) satisfies fl2.16|) . so under the conditions y (0) = 0, f (t) > 0, t > 
0, we get y (t) > 0, t > 0. Let Vi {t, s) be a Cauchy matrix for the equation ()3.55p . Then 
II Vi (t, s)|| = ||V^ {t, s)\\^j-f . Finally, applying ()3.53p we get the following bound in Iid norm 
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t 



J2q.pdt) = \\ym<\\Viit,0)\\ lly(0)||+ / \\V,it,r)\\ ||Df(r)|| dr 



\\Vi{t,T)\\ \\Df{T)\\ dr < irAoe(~('-^)* / e«'-^)^)a(r) (3.56) 

g(«~£)Ti 







< KXoam 1 + 



.{l-e)Ti - I ' 



Then 



if) < qj+i qiPi (t) < 

i>j i>j 



Let E{t; k) = ^ ipi {t) , t > 0, k > be the mean of the process at time t, if X{0) = k. 

i>l 

Corollary 3 . Under the assumptions of Theorem 1, 

Eit; k) < —KXoa^ il + J , Ve > 0, (3.57) 

where W = inf ^ > and I is defined as in 0^.5^) 
Proof. The claim follows from the inequality 

i>i i>i ^* i>i 

Consider now the case of finite state space. In this case the matrix D in ()2.25|) is also finite 
and we can obtain two-sided bounds both for the decay function and for 1 1 p^^^^ (t ) — p^^^ (t ) 1 1 , t > 
0. 

Theorem 3 Let the conditions of Theorem 1 hold and, in addition, N < oo. 
Then 

(i) for any s > 0, t > s, and any p^ (s) G Q, p^ (s) G Q 

e"^'"^"^" ||p^ (.) - (.)|L, < ||P« (t) - P^^Ut)|L, 

<e"^'^"^''"||p«(s)-p(2)(s)|l , 0<s<t, (3.58) 
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and 



g -JC(n)du II 1 2 / Ml ^ II W.N 2 

e » p (s) - p (s) < p [t) - p (t) 



4:NG 



ANG -Jaiu)du ,, , ^ ^ „ ^ 

< e' pi s -p2 s 3.59 

g 



where g = mirififc, G = maxdk, and a(t) , C{t), t > are defined in [ 2.31 ] and ^2.31^ 
respectively; 

(a) for any s > 0, t > s, and p^{s) < p^(s) 



|P' it) - it)ln > e'^"^"^'" I|P' (^) - P' (^)ILn > (3-60) 



and 



II a — f a(u)du ,, „ ,, 

PHt)-pHt) >J-e i pi(.)-p^(s) . (3.61) 



ANG 

Proof. We have to prove only estimates in li norm. We have 



2 



\\D\\ = ^di< NG; \\D-^\\ = 2maxd^^ < -. (3.62) 



i=0 



Then 



||pi (t)-p2(t)|| <2\\z' (t)-z' (t)|| < 

t 

11 — f a(u)du ,, , „ ,, 

2||D|| \\D-'\\e ' zi(s) -z2(s) (3.63) 



t 



^ ANG II 1 , , 2. Ml / 

< e = Ijz^ (s) - (s)|| < 

ANG -I^^{u)du 

e - p (s) - p (s) . 

On the other hand inequahty (j2.15p imphes the bound 

\\pHt) - pHt)\\ > F (t)-z^(t)||> 

t 

1-1 II n-lll-l -/fW'^" II 1 / N 2 



||D|r'||D-i|| e = ||z^(s) -z'(s)|| (3.64) 

t 

^ ^ -JCHd" II w . 2/ Ml ^ 



2ArG 

-e » ' llpi (s) - p^ (s) 



4iVG' 
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Remark 2 . The rate of convergence in the previous theorems is exponential. Therefore, our 
bounds provide an approach for obtaining integral estimates for the state probabilities and for 
the mean. Such estimates were obtained in I34]l - 



4 Null-ergodic BDPs 



Put 



(t) = h (t) + fik {t) - Sk+iXk (t) - Vfc it), k = 



.,N-1, t>0. 



and 



(4.65) 



a^") {t) = Maf it). 

k 



Let D be a diagonal matrix 



D = diag {do, (ii,...} 



where d^ = 1, di > 0, i E E. 

We define the induced Iid— norm by 



I ID 



|Dx||^ = ^^di \xi\ , X = (xi, ...,...) eh. 



i>0 



(4.66) 
(4.67) 



In the case considered all results are based on the bounds for the logarithmic norm 7 {A {t))^^) 
7 (DA (t) B-^)^ , where A{t), t > is defined in 
Hence, 



DA(t)D 



-1 



/ -Xo{t) dod^'i2i{t) 

did^'Xoit) -(Ai(t) +/ii(t)) did^^fi2{t) 
d2d^^Xi{t) 
': 



V 



t > 0. (4.68) 



Put 



AfiXk-i - Xfik , p 
hk = T": , k e hi. 



AXfx 



Theorem 4 Let for some A > 1 



inf hk = h > 0, 

keE 



(4.69) 



(4.70) 
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let c be a positive number under the conditions: 

c < 1; c < ^,A; > 0, c < h, (4.71) 
A 

and let 

\am - Afibm > 0. (4.72) 
Then there exists a sequence S = {6k, k & E) > 0, such that 
(^) 

(t) > e{t) = c (Aa (t) - A/x6 (t)) , (4.73) 

where liminf 6k < 1, if N = oo; 

(a) BDP X{t), t > is null-ergodic and 

°° - / e{u)du 



^diPi (t) < Ge ' , 0<s<t, (4.74) 



1=0 



where G = sup dk < oo. 



Proof. 

First we prove the inequalities 

«f (t) = a (t) Xk (1 - 6k+i) - b (t) fik {6k' - 1) > c (Aa (t) - Afib (t)) , (4.75) 

keE, t>0. 

It is sufficient to verify that 

Xk (1 - 6k+i) > cA, fik {6k' - 1) < c/iA, keE. (4.76) 
and ()4.76|) follows from 

4 < ^^-i^, (4.77) 

6k > ^^^-r, keE. (4.78) 

li N = oo and < c < 1, we have from ()4.77|) 



Hence, pTTTjl . (p77R|l imply 



A — cA 

limsup^fc < — - — = l-c<l. (4.79) 
A 



^^__^<^^_1^, keE (4.80) 

fXk+i + c/iA Afc_i 
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Since < c < the latter is equivalent to 

c^AA/i-c(AAfe_i/i- A/ifc) < 0, keE. (4.81) 

For fixed k the largest root of ()4.8H1 is hk given by ()4.69|1 . 
So, we have 

7(^(t))iD < -^W = -c(Aa(t) - A/i6(t)), t>0 (4.82) 

Then 

^ — . — f 9(u)du — f 9(u)du 

J2diP^{t) = \\pmiD<e ' \\p{s)\\,^<Ge i , 0<s<t, (4.83) 
for any p (s) G Q. This implies the exponential nuU-ergodicity of BDP. 



mm 



Now we are in position to bound the state probabilities in nuU-ergodic case. Put 
mm di > 0, j E E. 

Corollary 4 . Under assumptions of Theorem 4, 

t 

G - f e(u)du 

Pk{t)<—e ^ , keE, 0<s<t. (4.84) 
dk 



and 



Pr (X (t) < J I ^ (0) = A:) < o j,keE, t>0 (4.85) 



Proof. We have 



-, ^ G - f e(u)du 

Pk (t) < d^' V d,p, (t) <-fe ^ . (4.86) 

7^0 '^^ 



Thus, 

i 3 oo 



i=0 i=0 i=0 

t t 
- f e(u)du - f 9(u)du 

<e ||p(o)||^^ = 4e , (4.87) 

which implies fl4.85p . 

Remark 3 // BDP is null-ergodic then E (t; /c) — >• (X) as t ^ oo for any fixed k E E. Put 

r (t) = mm |ao (t) ; inf (A, (t) - /i, (t))| , t>0. (4.88) 
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Then 



dE{t;k) 
dt 



> r(t), and 



t 

E{t;k)>k + J r{T) dr. 



(4.89) 



5 Mt/Mt/1 queue 



There is a number of papers devoted to this queue, see the references in 122]. Here the number 
of customers X (t) at time t (the length of the queue) a BDP given by 

A„ (t) = a{t); fin (t) = b (t) (5.90) 

Bounds for this model were obtained in [SHI SHI HH] • 

Let p = l^i- be the traffic intensity. We consider underloaded (p < 1) and overloaded 
(p > 1) cases. 
Put 

a (t) = (1 - pi/2) (5 (^) _ _ ^5 

Put 5i = p~^^'^, di = p~*^^, i > I. Then we have in Theorem 1 c = 1 — p^^^, g = inf dk = 1, 

i-l i-1 

9i = dm = Yli K^) — ^ (^) 1 ^^"i Theorem 1 implies the following bound 

m=0 m=0 

Proposition 1 . For underloaded Mt/Mt/1 queue (am < bm) the following upper bound on 
the rate of convergence holds: 

||pi it) - (t)|| < 4e"^'^"^'" E (E /^""^^'l \P' (')-P" (^)l • (5-92) 

i>l tm=0 J 

Remark 4 . It is easy to see from 115.91]) that in the case considered a (t) = ^a/ a(t) — \/b{t) 
which is the "exact" decay function, since the exact value of the spectral gap (decay parameter) 
for the corresponding homogeneous case is a = ^^/a — Vb^ , see H^. 

1 

Corollary 5 . Let intensities be periodic with period Ti = T2 = 1 and am = J a(u)du < bm = 



1 

J b{u)du. Then a{t) is also 1-periodic and 




ttm := / a{u)du = (^y/a^ - ^/bZ^ . (5.93) 
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Theorem 2 and its Corollary imply the following statements 

Proposition 2 . Let Mt/Mt/1 queue he underloaded. Then for any £ > there exists K, 
such that 

Pr(X(t)<j|X(0)=0)> l-ira^|x;p-"/'| + J-e')^^ i ) ' (5-94) 

Corollary 6 . Let Mt/Mt/1 queue be underloaded. Then for any e > there exists K, such 
that 

E(,0)<^(l + j^^^). (6.95) 

where 

W = inf J ^ 1 > 0. 

t m=0 J 

Consider the overloaded queue. 

The conditions of Theorem 4 hold for 5j = p^^/^ < 1, di = p"*''^, c = p^/^ — 1. Then 
G = 1, 6* (t) = d (t) and we obtain the following statement 

Proposition 3 . For overloaded Mt/ Mt /I queue, (a„i > h„i) the following hound of the rate 
of convergence holds: 

E. — f a(u)du 

p-'/'V: {t)<e ' " , (5.96) 

i=0 

for any s > 0, t > s. 

Corollary 7 . If Mt/Mt/l queue is overloaded, then for any p{s) E Q and any k 

t 

, ,„ — f a(u)du 

Pk{t)<p^'^e s . (5.97) 
The following bound follows from Corollary of Theorem 4. 
Proposition 4 . If Mt/Mt/1 queue is overloaded, then 

t 

Pr (X (t) <j\X{<S) = k)< p^'^-^'^/^e" if (5.98) 

for any t > 0. 

With the help of ()4.89|) we get the following bound for the mean of the queue length. 
Proposition 5 . For any k and any t > 

t 

E{t;k)>k + I (a (r) - b (r)) dr. (5.99) 







19 



6 Mt/Mt/S queue 

For references see |S21, [HI], Here the length of the queue (the number of customers) 
is BDP X (t) with the intensities 

A„ (t) =a{t); fin (t) = b (t) min (n, S) . (6.100) 

Bounds for this process were obtained in 1231101, The estimates of probabihties 

for the perturbed Mt/Mt/S queue were studied in 

Let p = be the traffic intensity. We consider underloaded (p < 1) and overloaded 
(p > 1) cases. 



c = min( i ) , A>1. (6.101) 



Proposition 6 . Let Mt/Mt/S queue be underloaded. Then ( 3.4'^ holds for 

'1 A- 

Proposition 7 . Let Mt/Mt/S queue be overloaded. Then ^.73{ ) holds for 

A-1 

c=^— , A>1. (6.102) 

First, let the queue be underloaded. Put A = p~^/^. Then c = min 1 — p^/^). We 
consider the cases of heavy traffic p > {^^Y , c = 1 — p^^"^, and light traffic < p < 



c 



s- 



Put 

a{t) = c {Sb (t) - p-i/^a (t)) . (6. 103) 

Put Si = p"^''^, di = p^*^^, i > 1. Then we have in Theorem 1, = inf (i^ = 1, = 

i-l i-1 

J2 '^m = ^ p^™/^, l{t) = a (t) , and by Theorem 1 we have 

m=0 m=0 

Proposition 8 . For underloaded Mt/Mt/S queue (am < Sbm), the following bound for the 
rate of convergence is valid: 

\\p' it) - P' (t)|| < 4e"^''^"^'"5^ |x^p-/4 \pI is)-p^ is)\ . (6.104) 

i>l tm=0 J 

Remark 5 . For underloaded Mt/Mt/S queue with heavy traffic the exact "decay function" 
is a{t) = (^^/ a(t) — a/ Sb{t)^ because the exact value of spectral gap (decay parameter) for 

homogeneous case with heavy traffic is a = (^y/a — \^Sbj , see llUf . Moreover, for S = 2 the 
bound between light and heavy traffics is also exact. 
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1 

Corollary 8 . Let intensities be periodic with period Ti — T2 — 1 and — j a {u) du < 



1 

Shjn — S J b{u) du. Then a{t) is also 1-periodic and 


in the case of heavy traffic 



ar. 



in the case of light traffic 



0£r. 



1 

j a{u)du ^ i^^/a^ - ^/Sh^ . (6.105) 



1 

:— J a{u)du = bm — \/ Sambm- (6.106) 



Theorem 2 and its Corollary imply the following two statements 

Proposition 9 . Let Mt/Mt/S queue be underloaded. Then for any £ > there exists K, 
such that 

Fr{X{t)<j\X{0) = 0)> l-i^a^|x;p-/^| (^+ J-e^ni^ - (6-107) 

Corollary 9 . Let Mt/Mt/S queue be underloaded. Then for any £ > there exists K, such 
that 

E(t;0)<^(l + -5-j5^). (6.108) 

where ^ 

W = inf J i-^ ^ p-™/2 I > 0. 

1^ m=0 J 

Let now Mt/Mt/S queue be overloaded. Put A = p^^"^ . Then c = p^/"^ — 1. The conditions 
of Theorem 4 hold for 5i = p-V2 < 1^ di = p-^'"^, c = 1 - p^'"^. Then G = 1, e{t) = a{t) and 
we obtain 

Proposition 10 . For overloaded Mt/Mt/S queue (am > Sbm) the following bound for the 
rate of convergence is valid: 

^— > ■ ;r, — f Ct(u)du 

Y.p-''^m{t)<e i '\ (6.109) 

i=0 

for any s > 0, t > s. 
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Corollary 10 . If Mf/Mf/S queue is overloaded, then for any p{s) & Q and any k 

t 

, ,„ — f a(u)du 

Pk{t)<p^'^e i (6.110) 
The following bound follows from Corollary of Theorem 4. 
Proposition 11 . If Mt/Mt/S queue is overloaded, then 

Pr(X(t) < J I X(0) = A:) < p('=-i)/2e"if (6.111) 

for any t > 0. 

/^From ()4.89|) one gets the following simple bound for the mean of the length of the queue 

Proposition 12 . For any k and any t > 

t 

E{t;k)>k + j (a (r) - Sh (r)) dr. (6.112) 



7 A multiserver queue with discouragements 

This queueing model was studied in ^ EOl El ISS]- We have here BDP with the intensities 
A„ it) = Xna {t) ; yu„ {t) = finb (t) , where 

, A if n < \ nu ii n < S 

^_g_^_2 li n > b [ D/i it 72 > D 

So, in the case considered lim A„ = 0, which says that a straightforward application of 

ra— >oo 

Theorem 1 is impossible. Put 

f 1 if < ^ , , 

[ 1 + e d k> S 

where e G (0; 1). Then we have 

Ofc (t) = 6 (t) , k< S - 1; 
as-i (t) = bit)-a (t) (^i^ - 1 
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a^^sit) = Sbit)(l--^)-ait)(^-^), n = k-S>0. (7.115) 

Put 

cn = + (7.116) 

(n + 2)(n + 3) ^ ' 

If (n + 2) < then c„ < 0; if (n + 2) > then c„ < ^ < < f^- Finally we obtain 
for any k the following bound 

Se 

dk (t) > a{t) = {b (t) - ea (t)) . (7.117) 

Let bm > and let e G (0; 1) , be such that bm — £cim > 0. Then applying the estimates of 
Theorem 1 we obtain 



Proposition 13 . 



|pi it) - p2 it)\\ < 4e"^''^"^'"^^?, \p] is)-p^ {s)\ , (7.118) 



i—l m 

where qt = Yl II h- 

m=0 k=0 

Also, Corollary 2 and Theorem 2 imply, under the same assumption as above. 
Proposition 14 Let bm > 0- Then there exists K, such that 

Pr (X (t) < J I X (0) = 0) > 1 - qJ^.KXa,^ (^1 + -^^^^^^—^j . (7.119) 
Corollary 11 . Let bm > 0. Then there exists K, such that 



E(i;0)<^ l + j^^^l. (7.120) 



where W = inf {qi/i) > 0. 



8 Mt/Mt/S/S queue 

There is a large number of investigations of the M/M/S/S queue, see references in 

In particular, this queue is a subject of some new papers, see [12], [22], [2S1- In general 
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(nonstationary case) the length of a queue X (t) is a BDP on the state space E = {0, 1, . . . , S*} 
with the intensities 

Xn{t) =a{t); finit) =nb{t) (8.121) 

The first bounds for the general case were obtained in [SB], see also jl2lllSl; some of results 
of jHEj were repeated in [2H], and in the last paper non-Markovian case was also studied. 
Consider the condition 

ara + bra>Q. (8.122) 

One can see that BDP is not exponentially ergodic if ( I8.122|) is not fulfilled. 
Let ( IH:T^ holds. 
The first case. Let 

> 0. (8.123) 
Put 6k = 1, k = 1, . . . , S — 1. Then dk = 1, g = minc/fc = 1, G = maxdk = 1, and 

{bit) ifk<S — l 
b{t) + a [t) ijk = 5 — 1 

and 

a (t) = inf Ofc (t) = 6 (t) , (8.125) 

k 



p (t) = snp ak (t) = a {t) + b {t) , (8.126) 

k 



C (t) = sup {Xk (t) + (t) + 4+iAfc+i (t) + 5^Vfc W} < 2a (t) + (2^ - 1) b (t) . (8.127) 

k 

Now Theorem 3 implies 

Proposition 15 . Let the condition f \8.12'J\f he satisfied. Then for any s > 0, t > s, 
pi (s) G p2 (s) G VL 



llD - l|f y--' t- v-/||i£,^- ||f V"/ f V"/||iD' 

(8.128) 

and 



1 - / ~au)du 

— e " 
45 



|p^ (.)-p^(.)||^< ||p^ (t)-p^ W||i<45e' 



- J a{u)du 



P 



(8.129) 
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Remark 6 . // the intensities are constant, then the hounds \8.12^) and \8.129\) immediately 
imply the inequality (17) in the paper ^131 It is interesting to note that such bound in general 
case was found about ten years ago in ^38]. The cutojf property, which is studied in fl^ and 
\3f^ can be naturally investigated by our methods. It will be a subject of a separate paper. 

Proposition 16 . Let the condition ( \8.123\) be satisfied. Then for any s > 0, t > s, and 
(s) < (s) the following bounds hold 

t 

it) - p2 > e"^'^"^'" ||p^ (.) - p2 (.)||^^ , (8.130) 

and 

t 

111 o II 1 — f P{u)du ., „ .. 

||P^ it) - (t)|L >J-s^ ' W is) - P' is)l . (8.131) 



{«— 1 m 
s n 
m=0 fc=0 

1. 

Theorem 2 and its Corollary imply the following statetment. 

Proposition 17 Let the condition ( \8.123\} be satisfied. Then for any e > there exists K, 
such that 

Ka ( Ahra-s)r^ \ 
Pr (X (t) < J I X (0) = 0) > 1 - 1 + , . (8.132) 



j + 1 \ (A^^-<^)Tx - I J ' 

and 

E {t; 0) < Ka^ i^l + ^(,_,)^^ _ J • (8.133) 

On the other hand, the estimate of the mean of the number of customers in the queue can 
be obtained in the following way: 

s s-i s 

-1 = \^ (t) rin 4- ' 

dt 



= Ao it) Po + Yl - (^)) = « (^) 5^ P^ -bit)J2 ^ 

i=l 1=0 i=0 

S 

a{t)^Pi-b {t) E (t; k) = a{t)-b [t) E (t; k) . (8.134) 

i=0 

By integration of this inequality we get 
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Proposition 18 The following bound for the mean of the length of Mf/Mt/S/S queue holds: 

t t t 

— f b(u)du r — f b(u)du 

E{t;k)<ke + aiT)e ' dr. (8.135) 



Remark 7 . The bound iS.l^^) seems to be sufficiently sharp for the case of light traffic. It 
is interesting to study its sharpness in the general case. 



The second case. Let now 

a„ > 0. (8.136) 

Put 4 = (5 = ^ < 1, A; = 1, . . . , ^ - 1. Then 

akit) = Afc (t) + Aife+i (i) - 4+iAfc+i (t) - Vfc W (8.137) 
{l-6)a{t) + {k- !^)b{t) ,ifk<S-l 
a(t) ,if k = S — 1 

and 

a{t) = m{ak{t) > (1 - 5) a (t) = (8.138) 
f3 (t) = sup ak (t) <a{t) + b{t)=(3 (t) , (8. 139) 

k 



C {t) = sup {Afc {t) + fik+i {t) + 4+iAfc+i (t) + Vfe (t)} <{l + S)a (t) + 2Sb {t) . (8.140) 

k 

Then by virtue of Theorem 3, we have 
Proposition 19 Let the condition f \8.13(^) hold. Then for any s > 0, t > s, and any 

pi (s) G n, p2 (s) G n 



— f C(u)du .. , _ 11 II /I \ /n\ ir ~ [ a(u)du II /,s II 

e'^' ||pi(.)-p^(.)||,^<||p«(t)-p(^)(t)||,^<e ^ ||P^^^(^)-P^'U^)|L^, 

(8.141) 

and 



S — 1 ^ f C(u)du ,, „ ,, ,, , „ ,, 

^e'^^^ WpHs) ~ {s)l < \\p' it) - {t)l (8.142) 



^ 452 -I&(u)du 

- jzr^'' ' ||p (s)-p'(s) 
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Proposition 20 Let the condition ( \8.13b]) hold. Then for any s > 0, t > s, and (s) < 

p^ (s) the following bounds are valid 

t 

(t) - P' it)ln > I|P' (^) - P' (^)lliD ' (8-143) 

and 

\W{t)-v\t)\l>^e i \\v'{s)-v\s)\l. (8.144) 
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